Acceleration of the EM algorithm using the vector epsilon algorithm
نویسندگان
چکیده
The Expectation-Maximization (EM) algorithm is a very general and popular iterative computational algorithm to find maximum likelihood estimates from incomplete data and broadly used to statistical analysis with missing data, because of its stability, flexibility and simplicity. However, it is often criticized that the convergence of the EM algorithm is slow. The various algorithms to accelerate the convergence of the EM algorithm have been proposed. The vector ε algorithm of Wynn [14] is used to accelerate the convergence of the EM algorithm in Kuroda and Sakakihara [6]. In this paper, we provide the theoretical evaluation of the convergence of the ε-accelerated EM algorithm. The ε-accelerated EM algorithm does not use the information matrix but only uses the sequence of estimates obtained from iterations of the EM algorithm, and thus it keeps the flexibility and simplicity of the EM algorithm.
منابع مشابه
Application of Genetic Algorithm Based Support Vector Machine Model in Second Virial Coefficient Prediction of Pure Compounds
In this work, a Genetic Algorithm boosted Least Square Support Vector Machine model by a set of linear equations instead of a quadratic program, which is improved version of Support Vector Machine model, was used for estimation of 98 pure compounds second virial coefficient. Compounds were classified to the different groups. Finest parameters were obtained by Genetic Algorithm method ...
متن کاملMidcourse Trajectory Shaping for Air and Ballistic Defence Guidance Using Bezier Curves
A near-optimal midcourse trajectory shaping guidance algorithm is proposed for both air and ballistic target engagement mission attributes for generic long range interceptor missile. This guidance methodology is based on the maximum final velocity as the objective function and maximum permissible flight altitude as the in-flight state constraint as well as the head-on orientation as the termina...
متن کاملEconomic Dispatch of Thermal Units with Valve-point Effect using Vector Coevolving Particle Swarm Optimization Algorithm
Abstract: This paper is intended to reduce the cost of producing fuel from thermal power plants using the problem of economic distribution. This means that in order to determine the share of each unit, considering the amount of consumption and restrictions, including the ones that can be applied to the rate of increase, the prohibited operating areas and the barrier of the vapor barrier, the pr...
متن کاملOptimal Placement of Remote Control Switches in Radial Distribution Network for Reliability Improvement using Particle Swarm Optimization with Sine Cosine Acceleration Coefficients
Abstract: One of the equipment that can help improve distribution system status today and reduce the cost of fault time is remote control switches (RCS). Finding the optimal location and number of these switches in the distribution system can be modeled with various objective functions as a nonlinear optimization problem to improve system reliability and cost. In this article, a particle swarm ...
متن کاملModified frame algorithm and its convergence acceleration by Chebyshev method
The aim of this paper is to improve the convergence rate of frame algorithm based on Richardson iteration and Chebyshev methods. Based on Richardson iteration method, we first square the existing convergence rate of frame algorithm which in turn the number of iterations would be bisected and increased speed of convergence is achieved. Afterward, by using Chebyshev polynomials, we improve this s...
متن کامل